Hadoop环境下基于SparkSQL海量自动站数据查询统计初探     

黄志  詹利群  任晓炜  李涛 《气象科技》2019,47(5):768-772

在Hadoop分布式计算和存储架构下,自定义ETL数据清洗规则将海量自动站小时单站文件按所属年和站号合并为大文件流转存储至HDFS中,并运用SparkSQL并行计算框架进行统计处理生成常用气象要素日统计值。结果表明,数据处理和获取时效较关系型数据库方式有显著提升。采用SparkSQL并行计算框架对多气象要素多站点和长时间序列进行数据统计处理查询均能达到秒级别响应,并随着统计站点数的不断增加和时间跨度的延长其优势更为明显,能更高效地支撑此类气象数据服务,为海量气象数据处理从关系型数据库到大数据分布式架构的转换处理提供了新思路。  相似文献   

陕西关中两次霾重污染过程气象条件分析     

黄少妮  孟金平  杜莉丽  刘慧 《气象科技》2019,47(5):809-817

应用常规观测资料、污染物浓度资料和NCEP 1°×1°再分析资料从环流形势、边界层特征和扩散条件等方面对2013年和2016年两次持续性霾重污染过程进行对比分析。结果表明:①2013年过程和2016年过程在500hPa高空上分别为阻塞环流型和纬向环流型,关中地区受偏西气流影响、地面气压场较弱、大气层结均比较稳定;②2013年过程西安贴地逆温层顶高度低、相对湿度大、气温低、不利于大气垂直湍流交换,污染物容易堆积,这也是2013年过程比2016年过程重污染持续时间长、污染浓度高的原因之一;③两次过程西安平均风速均小于2m/s,具有显著的低风速特征,且东北风为其主导风向。持续东北风引起上游污染传输和低风速导致的本地污染累积是造成2013年过程污染浓度更高的重要因素;④2013年过程结束是受强冷空气影响,来自高空的干洁大气下沉到地面,置换了边界层的污染空气,使空气质量得到根本改善;而2016年过程是受高原槽东移影响,雨雪天气的沉降作用使得霾消散。  相似文献   

百色气候变化特征及城市适应策略建议     

何洁琳  陆甲  李艳兰  谢敏  黄卓  周美丽  黄雪松  秦川 《气象研究与应用》2019,(1):34-37

利用气候观测数据分析表明,近60a来,百色出现了与全球气候变化背景一致的增暖变化,主要变化特征有:气温明显升高,年降水日数减少,冬季降水量增多,年日照时数减少;高温和干旱频率高,20世纪90年代以来暴雨日数偏多。与广西平均气候变化状况相比,百色的气候变化程度风险低于广西平均水平。预估到本世纪中期,百色气温仍将缓慢升高,干旱和强降水的强度可能加剧。建议科学规划,统筹协调,科学评估城市气候承载力,开展城市适应气候变化风险管理,提升生态气候环境监测及自然灾害预警应急能力,建设生态气候宜居城市。  相似文献   

Eastward extrusion and northward expansion of the Tibetan plateau—discussions for the deep processes of the plateau uplift     

Zhou Ye  Rui Gao  Qiusheng Li  Xiao Xu  Xingfu Huang  Xiaosong Xiong  Wenhui Li 《《地质学报》英文版》2018,92(Z1):79-79

  相似文献   

Geochronology,Geochemistry and Petrogenesis of the Pungco Ophiolite,TibetEI北大核心CSCD     

Wang X.  Xia B.  Liu W.  Zhong Y.  Hu X.  Guan Y.  Huang W.  Yin Z. 《大地构造与成矿学》2018,(3):550-569

Although the middle section of the Bangong-Nujiang suture zone has been intensively investigated, its tectonic framework and evolution is still controversy. The Pungco ophiolite has a relative complete ophiolitic complex, which is an ideal specimen for studying this tricky problem. LA-ICP-MS U-Pb dating of zircons from the diabasic rock yielded an age of 159.0±2.1 Ma. This age suggests that the Pungco ophiolite was formed in the Late Jurassic, indicating the development of the Late Jurassic ophiolite in the third ophiolitic subzone. The whole-rock major and trace element compositions of diabasic and basaltic rocks exhibit mixed arc and N-MORB geochemical characteristics. Two diabasic samples have (87Sr/86Sr)i values of 0.7055 and 0.7063 and εNd(t) values of 11.28 and 11.84, respectively. The geochemical signatures and formation age of the Pungco ophiolite suggest that this ophiolite was probably produced in an active continental fore-arc setting. It originated from a N-MORB-like depleted mantle source with the involvement of subducted-slab fluids. Considering the regional geological background, the Pungco ophiolite was likely generated during the southward subduction of the Bangong-Nujiang Tethyan oceanic lithosphere beneath the Lhasa terrane, and belongs to a regional archipelagic arc-basin system together with the other Early Jurassic-Early Cretaceous ophiolites from the northern Tibet Lake district. © 2018, Science Press. All right reserved.  相似文献   

高分遥感技术在西昆仑大红柳滩-俘虏沟地区地质找矿中的应用          下载免费PDF全文

王辉  秦绪文  范玉海  杨金中  金谋顺  张少鹏  廖友运  杨晨  崔胜  贺小龙  匡经水  郭鹏程 《中国地质》2018,45(6):1289-1301

在西昆仑大红柳滩-俘虏沟地区,以WorldView-2高空间分辨率数据为主要信息源,在标准影像图制作基础上,针对性地进行图像增强处理,突出相关控矿要素和矿化信息,开展地质矿产遥感解译;利用ASTER数据开展矿化蚀变有关的遥感异常信息提取,配合适量的野外调查验证,发现了4种极具找矿前景的矿化带类型：①大红柳滩（含稀有金属）花岗伟晶岩带1处;②大红柳滩层控型铁多金属矿化带1处;③俘虏沟燕山期花岗岩有关热液脉型铁、铅、银、铜矿化区1处;④俘虏沟层控型含铜铅锌银的菱铁-赤铁矿矿化带4处;通过遥感综合分析,圈定遥感找矿靶区11处,其中A级遥感找矿靶区5处、B级遥感找矿靶区3处、C级遥感找矿靶区3处,为后续区域地质矿产调查项目规划部署和矿产资源勘查评价提供依据。因此,高分遥感技术在西昆仑地区矿产地质综合调查中作用显著,可实现找矿工作的快速突破,值得在相同或类似区域进一步推广应用。  相似文献   

U–Pb zircon age of the base of the Ediacaran System at the southern margin of the Qinling Orogen     

Lecai Xing  Taiyi Luo  Zhilong Huang  Zhikuan Qian  Mingzhong Zhou  Hongtao He 《中国地球化学学报》2018,37(3):414-421

Global abrupt climate change from Marinoan snowball Earth to greenhouse Earth, recorded as cap carbonate overlain on diamictite, had shed the first light on Cambrian bio-radiation. The most documented cap carbonate sections are typical with comprehensive δ¹³C negative values and ubiquitous sedimentary structures, such as tepee-like, sheet-crack etc., which are associated with successive glacial eustatic variation caused by isostatic rebound in shallow-water facies. Here we report a deep-water basinal cap carbonate section with strong negative δ¹³C values in the southern margin of the Qinling Orogen, Heyu, Chengkou County, Chongqing in China, which consists of massive dolostone with abundant carbonaceous laminae. However, it lacks the sedimentary structure as mentioned above and is overlain by thin-bedded silicious shales and cherts. A K-bentonite bed was discovered within the base of cap carbonates, about 0.7 m above the top of the Marinoan diamictite. Magmatic zircons that were separated from the K-bentonite bed yield a SIMS concordia U–Pb age of 634.1 ± 1.9 Ma (1σ, MSWD_CE = 0.31, Probability_CE = 1.000, n = 20). The age is in good agreement with previously reported TIMS U–Pb ages for the termination of Marinoan glaciation and provides a geochronological constraint for the Ediacaran successions in the Qinling Orogen.  相似文献   

Late Quaternary Slip Rate of the Xiugou Segment,Eastern Kunlun Fault Zone   总被引：1，自引：0，他引：1  

Feipeng Huang  Junjie Ren  Yanwu Lü  Junxiang Zhao 《地球科学进展》2018,33(3):321-332

The Eastern Kunlun fault zone (EKLF) is a large left-lateral strike-slip fault, whose slip rate is meaningful to seismic hazard assessment and geodynamics of the Tibetan Plateau. Previous studies suggested that the late Quaternary average slip rate was stable and uniform (10~13 mm/a) in the central and western segment of the EKLF. But there were a few researches of accurate slip rate in the central segment on the EKLF. Therefore, we focused on an offset and well preserved alluvial fan from Xiugou basin, located in the east of Xidatan-Dongdatan, to make it clear. Moreover, we used high-resolution satellite images and digital elevation model extracted from SPOT7 stereo image pairs to restore the offset alluvial fan, and combined terrestrial cosmogenic nuclides method, including 13 quartz-rich samples from this fan surface, 1 quartz-rich sample from the main active channel bed and 1 ¹⁰Be depth profile from this fan edge to eliminate the ¹⁰Be concentration of inheritance accurately, with 1 optically stimulated luminescence sample to obtain the reliable age of this alluvial fan together. Referring to field observations, this alluvial fan was offset left-laterally by (1 862±103) m, and its age is (76.55±3.20)~(106.37±3.38) ka which can be determined through the actual geologic setting and improving chi-square test. Thus, we used the Monte Carlo method to obtain a left-lateral slip rate of (20.3+3.5/-2.3) mm/a with 68% confidence envelopes since the late Pleistocene in the Xiugou basin. As a result, combining with the results of previous studies, the left-lateral slip rate indicated that the obviously decreasing activity transferred from late Pleistocene to Holocene on the central segment of the EKLF.  相似文献   

A model for the representation of emergency cases     

Chao Zhang  Jiansong Wu  Chao Huang  Bo Jiang 《Natural Hazards》2018,90(1):337-348

The aim of this paper is to propose a location model of earthquake emergency service depot on the basis of hybrid multi-attribute decision-making method. The advantage of the proposed method is that practical mixed uncertainty of location decision information is considered, and the corresponding factors that affect the location of transfer stations are contained. To solve the location problem, a hybrid multi-attribute decision procedure without information transformation is developed. Besides, a novel weighting method and aggregation process is given. Finally, a numerical example is provided to show the feasibility and validity of the proposed method.  相似文献   

Water system characteristics of Karst river basins in South China and their driving mechanisms of hydrological drought     

He  Zhonghua  Liang  Hong  Yang  Zhaohui  Huang  Fasu  Zeng  Xinbo 《Natural Hazards》2018,92(2):1155-1178

Natural Hazards - It is common knowledge that drought is considered one of the most damaging natural disasters in terms of economic costs, societal problems, and ecological impacts. In this study,...  相似文献